Wizard-of-Oz Data Collection for Perception and Interaction in Multi-User Environments
نویسندگان
چکیده
In this paper we present the setup of an extensive Wizard-of-Oz environment used for the data collection and the development of a dialogue system. The envisioned Perception and Interaction Assistant will act as an independent dialogue partner. Passively observing the dialogue between the two human users with respect to a limited domain, the system should take the initiative and get meaningfully involved in the communication process when required by the conversational situation. The data collection described here involves audio and video data. We aim at building a rich multi-media data corpus to be used as a basis for our research which includes, inter alia, speech and gaze direction recognition, dialogue modelling and proactivity of the system. We further aspire to obtain data with emotional content to perfom research on emotion recognition, psychopysiological and usability analysis.
منابع مشابه
Multi-Session Group Scenarios for Speech Interface Design
When developing adaptive speech-based multilingual interaction systems, we need representative data on the user’s behaviour. In this paper we focus on a data collection method pertaining to adaptation in the user’s interaction with the system. We describe a multi-session group scenario for Wizard of Oz studies with two novel features: firstly, instead of doing solo sessions with a static mailbo...
متن کاملAutomated wizard-of-oz for spoken dialogue systems
Designing and building natural language spoken dialogue systems require large amounts of speech utterances, which adequately represent the intended human-machine dialogues. For this purpose, typically, first a “Wizard-of-Oz” data collection is performed, and then the collected data is transcribed and labeled by expert labelers. Finally, the data is used to train both the speech recognizer and t...
متن کاملHelp, Anyone? A User Study For Modeling Robotic Behavior To Mitigate Malfunctions With The Help Of The User
Service robots for the domestic environment are intended to autonomously provide support for their users. However, state-of-the-art robots still often get stuck in failure situations leading to breakdowns in the interaction flow from which the robot cannot recover alone. We performed a multi-user Wizard-of-Oz experiment in which we manipulated the robot’s behavior in such a way that it appeared...
متن کاملDeveloping Smart Domestic Applications using a Wizard of Oz Methodology
In this paper we consider how ‘smartness’ should be designed to enhance the communication in the home. We aim to evoke a rethinking of how smart technologies should be embedded in perspectives of user needs. Through a set of experimental studies, which employ a Wizard of Oz (WoZ) as design and evaluation methodology, we observe and analyse user interactions accordingly with the wizard’s simulat...
متن کاملA Wizard-of-Oz Environment to Study Referring Expression Generation in a Situated Spoken Dialogue Task
We present a Wizard-of-Oz environment for data collection on Referring Expression Generation (REG) in a real situated spoken dialogue task. The collected data will be used to build user simulation models for reinforcement learning of referring expression generation strategies.
متن کامل